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ON  DIAGONALIZATION  METHODS  IN  INTEGER  PROGRAMMING 
by  Richard  Van  Slyke  and  Roger  Wets 


I.  Introduction 

An  important  area  for  improvement  in  existing  integer  programming 

codes  is  in  the  easy  generation  of  efficient  cutting  hyperplanes;  in  this  paper 

we  approach  this  problem  using  a  triangular  canonical  form.  In  the  first 

part  we  give  an  algorithm  based  on  Gomory's  all-integer  integer  program- 

\2] 

ming  algorithm1  J  ,  which  constitutes  a  first  step  in  this  direction.  This 
procedure  is  a  practical  analog  of  a  deepest  cut  method  discussed  in  the 
second  part  of  the  paper.  In  Appendix  A,  a  brief  outline  and  flow  diagram 
for  the  algorithm  are  given;  finally  the  algorithm  and  the  deepest  cut  prob¬ 
lem  are  illustrated  by  examples  in  appendices  B  and  C. 

We  assume  that  we  have  at  hand  an  integer  program  where  all  the 
coefficients  and  constant  terms  are  integers.  The  functional  is  to  be 
maximized.  We  write  the  problem  in  a  parametric  form  due  to  Tucker: 


Maximize  Xq  subject  to 

Xj  integer. 

j  =  0,  .  .  .  ,  n; 

j  =  1,  ....  n;  and 

xo  =  bo  +  coto 

+  C  jtj  +  . 

.  .  .  +  cktk 

X1  =  bl  +  al0t0 

+  ai  1*1  +  * 

.  .  .  +  alktk 

x 

m 


a  _  t_ 
mO  0 


amlll 


amktk 


It  will  be  convenient  to  assume  that  the  above  system  has  the  property 
that  if  Xq,  Xj,  ....  x^  are  non-negative  integer  variables  then  tg,  .  .  .  ,  t^ 
must  also  be  non-negative  integer  variables.  We  can  guarantee  this,  in 


k.  In  this 


general,  by  adding  the  trivial  relations  x.  +  ^  =  L,  i  =  0,  .  . .  , 
case  the  problem  will  be  of  the  form: 


(!') 


Maximize  Xq  subject  to  x^  non-negative  integers,  j  =  l,...,n;  and 


-  b0  +  c0t0  +  cltl  +  •  •  *  +  Vk 


"k+l  ~  -  Tc 

*k+2  =  bk+2  +  ak+20t0  +  ak+21tl  +  •  •  •  +  ak+2klk 


x  =  b  +  a  ntA  +  a  ,  t,  + 
n  n  nO  0  nl  1 


+  anktk 


If  in  this  problem  b^  >  0,  i  =  1,  2,  .  .  .  ,  n  and  c^  <  0  for  j  =  0,  1,  .  .  .,  k 
the  solution  obtained  by  setting  t^  =  t ^  •  =  t^  =  0  is  optimal. 

It  can  be  assumed  without  loss  of  generality  that  for  bounded  problems 
the  problem  is  in  a  dual  feasible  form,  such  that  c^  <  0  for  all  j.  A  quite 
general  method  for  accomplishing  this  is  discussed  in  a  paper  by  Dantzig, 

Ford  and  Fulkerson?^ 


Two  Useful  Operations 

We  now  describe  two  basic  operations  which  will  frequently  be  used: 
a)  The  Cut:  Suppose 


(2)  xi  =  bi  +  aiQt0  +  ail4l  +  *  *  *  +  ailtl  +  •  •  •  + 


is  an  equation  of  (1).  Let 
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J 


+ 


:  a. .  >  0 
U 


} 


and 


If  is  to  be  a  non-negative  variable  we  have  the  following: 


0  <  x.  =  b.  +  )  a..t.  +  )  a..t.  <  b.  +  )  a..t. 

-  i  1  Z.  vi  J  L,  y  j  -  i  L  u  J 


jeJ 


jeJ‘ 


jeJ 


If 


(3) 


T  =  b.  + 

i 


y  ..... 

L  u  j 


jeJ 


then  t  is  a  non-negative  integer  valued  variable.  Using  (3)  we  could 
eliminate  one  of  the  t' s  appearing  in  (3),  say  t^  in  (1)  in  favor  of  t. 
If,  moreover,  a^  =  1  making  the  substitution  tj  =  T  -  b^  -  ^  aijtj 


jeJ+-{i} 


in  (1)  would  leave  the  tableau  in  integers. 


xo  =  bo  +  cot 


X1  =  bi  +  aioto+  •••  +a 


U  (T  •  bi  -  I 


a.  .t.  )+...+  am  t, 

ij  J  /  Ok  k 


a..t.  +  .  .  .  +  a . ,  t. 

iJJ  /  Ik  k 


x  =  b  +  a  -t,.  +  .  .  .  +  a  .  r 
n  n  nO  0  ni 


-  b.  -  Y  a..t.  ^ 

1  L  lJ  J  / 


a.  .t.  +  .  .  .  +  a  ,  t, 

ij  J  /  nk  k 


jeJ+~  {i  } 


If  a  .  >  1  s  then 


-3- 


b* 


(3') 


T  = 


h'Z 


* 
a. . 
ij 

aii 


jer 


5*t  j*t 

is  still  a  non-negative  integer  variable  where  -b^  and  a_  are  the  smallest 
integers  greater  than-b^  and  a^  ,  respectively,  which  are  divisible  by 

5{s 

a^,  where  (a.#/a.#)  =  (a.#/a.#)  =  1,  so  if  a^  >  1,  we  can  uae  (31)  and 


*il*  ' “ii  '  ~  ' “il '  “ii' 

maintain  the  tableau  in  integers. 


To  minimize  the  notation  after  the  substitution  we  simply  let  T  be 
represented  by  t^  in  the  tableau.  In  general  we  only  use  the  substitution 
(3)  or  (31)  when  b^  <  0  and  in  this  case  call  it  a  cut  because  the  restriction 

T  >  0  restricts  the  value s  that  tg . t^  can  take  on,  e.g.,  tg  =  t^  =  ...  =  t^  =  0 

is  not  a  feasible  solution. 

b)  The  Column  Operation:  On  the  other  hand  if  we  define  t  =  ^  Ojt^  , 

j 

where  a ■  are  non-negative  integer  parameters  and  a.  -  1,  and  substitute 
J  - 

for  tj,  we  are  in  fact  performing  a  column  operation,  because  formally  the 
substitution  is  equivalent  to  subtracting  times  the  I**1  column  of  coef¬ 
ficients  of  (  l1 )  from  the  i*  column  of  (  l1 )  for  i  =  0,  1,  .  .  .  ,  i-  1,  £+ 1 ,  .  .  .  ,  k. 

We  note  that  this  is  of  the  form  of  a  cut  with  b^  =  0.  The  only  thing  we  have 
to  be  careful  about  in  making  these  substitutions  for  cuts  and  column  opera¬ 
tions  is  that  the  optimality  condition  for  the  transformed  tableau  is  the  same 
as  for  the  original;  more  specifically  that  x^,  .  .  .  ,  >  0  and  integer 

implies  that  the  current  tg,  .  .  .  ,  t^  are  non-negative  integer  parameters. 

This  is  easy  to  verify  remembering  that  the  original  tableau  had  this  property 
and  that  each  new  parameter  is  a  non-negative  integer  weighted  sum  of 

V  •  •  ‘  ’  V 
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II.  The  Basic  Algorithm 


Ralph  Gomory's  all-integer  algorithm  concerns  itself  basically  with 
making  "cuts"  in  a  systematic  fashion  until  a  transformed  tableau  of 
integers  is  obtained  from  (1)  with  c^  <  0,  (j  =  0,  .  .  .  ,  k),  b^  >  0,  (i  =  1,  .. .  ,  n) . 
The  question  is  how  to  generate  the  most  efficient"  cuts  in  some  sense. 

r2i 

Gomory  has  suggested1  1  that  the  efficiency  may  be  related  to  the  lexico¬ 
graphic  magnitude  of  the  pivot  column  in  the  sense  that  one  should  try  to 
minimize  the  magnitude  of  the  pivot  column.  Whenever  we  attach  adjectives 
such  as  "best",  "efficient",  "deep"  to  the  word  "cut"  we  will  always  mean 
it  in  this  way. 


1.  The  Algorithm. 

Suppose  our  problem  is  in  the  form: 

Maximize  x^  where  x^  >0,  (j  =  1 . n);  and  x^  are  integers  (j=0,...,n) 

subject  to 


xo 

=  bo 

- 

*o 

X1 

=  bl 

+ 

aioto  * 

*1 

X2 

b2 

+ 

a20*0  + 

a2 1*1  '  *2  . 

’‘k+l  bk+l  +  ak+l,  0*0  +  ak+ 1,  1*1  +  ak+ 1,  2*2  + 
^+2  "  bk-+2  +  ak+2,  0*0  +  ak+2,  l4!  +  ak+2,  2*2  + 


k+ 1 


+  ak+2,k+l*k+l 


an0t0 


anl*l 


an2*2 


ank+ l*k+ 1 


Then  finding  efficient  cuts  is  relatively  easy  since  the  columns  are  already 

ordered  lexicographically.  We  seek  a  cut  T  =  /3.  +  >  a.t.  for  which  the 

^  f  •  J  J 
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last  positive  coefficient,  which  determines  the  pivot  column,  is  as  far  to  the 
left  as  possible.  This  follows  because  we  always  insist  on  maintaining  dual 
feasibility.  It  is  clear  that  the  more  "efficient"  a  cut,  the  fewer  columns 
(in  general)  will  be  affected  by  the  pivoting.  With  this  criterion  in  mind  we 
seek  to  generate  the  cuts.  We  will  see  in  the  next  section  that  every  problem 
of  the  form  (1')  and  therefore  of  the  form  (1)  can  be  put  in  the  form  (5). 

We  can  consider,  instead  of  a  single  equation,  a  sum  of  equations 
weighted  by  positive  integers  to  generate  the  cuts.  To  each  equation  say  the 
i**1,  with  a  negative  constant  term,  we  associate  a  most  efficient  cut  in  the 
following  sense: 

(i)  If 

(a)  the  coefficient  of  t^+^a^  ^  is  positive  we  add  a..  times 

the  k+lst  equation  to  the  i**\  if  this  keeps  the  constant  term 

b.  +  a.  .  ,b.  .  negative,  we  go  to  (ii).  If  it  makes  the  constant  term 

1  I,  K+  1  K+  1 

th 

non-negative  then  the  original  equation,  the  i  ,  is  associated  with 
itself. 

(b)  a^  is  negative  or  zero  we  proceed  directly  to  (ii). 

(ii)  We  now  have  a  new  linear  combination  of  the  t's  where  the 

coefficient  of  t^+  ^  is  non-positive.  Next  we  examine  the  coefficient  of 

t,  which  is  a.  .  +  a.  ,  ,  .  a.  ,  ,  ,  in  case  (a)  or  a.  .  in  case  (b).  As  in 
k  l,  k  i,  k+1  k-(-l,k  i,  k 

(i),  if  the  coefficient  is  negative  or  zero  we  go  on  to  consider  t^  If  this 
is  not  the  case  we  add  a.  ,  +  a.  ,  .a,  ,  ,  times  the  k1*1  equation  if  this 

lj  K  If  Kt  I  Kt  1  K 

keeps  the  constant  term  negative.  If  it  does  not,  the  current  linear  combina¬ 
tion  is  associated  with  the  i^*1  equation,  and  we  stop. 

(iii)  We  continue  the  process  until  either  the  constant  term  goes  non¬ 
negative  and  the  process  terminates  or  until  a  positive  integer  weighted 
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combination  of  equations  is  obtained  in  which  the  coefficient  of  every 


tj»  (j  £  0)  is  non-positive.  If  one  obtains  an  equation  with  all  coefficients 
non-positive  and  with  a  negative  constant  term,  there  is  no  feasible  solution. 
In  this  way,  we  can  associate  to  each  equation  with  a  negative  constant  term 
another  derived  equation.  We  can  then  choose  from  the  collection  of 
derived  equations  the  one  for  which  the  last  positive  coefficient  is  farthest 
to  the  left.  From  this  equation  we  generate  the  cut.  We  then  repeat  the 
whole  process  with  the  new  tableau. 


The  convergence  properties  of  this  basic  algorithm  are  closely 
connected  to  those  of  Gomory's  all-integer  algorithm^  .  For  completeness 
we  review  the  proof.  Because  of  the  special  nature  of  the  tableau  there 
will  always  be  a  decrease  in  the  constant  term  in  some  row  above  the 
highest  row  with  a  negative  constant  term.  This,  plus  the  assumption  that 
a  feasible  solution  exists,  is  enough  to  guarantee  convergence.  To  see  this, 
we  note  that  for  each  iteration  we  add  a  lexico-negative  vector  to  the  constant 
column,  so  that  the  constant  column  is  always  decreasing  lexicographically. 

If  we  indicate  by  a  superscript  the  iteration  numbers  for  the  constant  terms, 
we  have  for  the  constant  term  of  the  functional: 


h(°)  >  h(U  >  ^  h(^)  .  .( i )  ,  (optimal,  feasible) 

D0  -  0  —  *  '  *  -  0  _  °o  _  •  •  •  _  0 


where  strict  inequality  can  hold  at  most  a  finite  number  of  times,  i.  e.  , 
there  is  a  Vq  such  that  b^  =  for  all  v  >  Vq.  For  if  this  were 

not  so,  since  b^  decreases  by  an  integer  each  time,  we  would  have 
strict  inequality  and  the  functional  value  would  eventually  become  less  than 
the  functional  value  of  the  assumed  feasible  solution,  which  is  impossible 
since  Xq  <  b^  for  every  v.  Now  from  i/q  on  we  examine  b[^(i/  >Vq). 
They  satisfy  the  condition  b^0+^  >  b^O"*"^  >  .  .  .  .  Suppose  b^1^  does 


-7- 


not  "settle  down 


i.  e. ,  suppose  strict  inequality  does  not  hold  at  most  a 
finite  number  of  times,  then  eventually  becomes  negative.  This  is  a 

contradiction  for  the  cut  generated  at  this  point  would  cause  a  strict  de¬ 
crease  in  b^  which  is  impossible  since  v  >  v q.  So  after  a  finite  number 
of  iterations  (>1^)  both  bg  and  b^  have  "settled  down."  Suppose 
bp,  .  . . ,  b^  ^  have  settled  down,  then  if  b^  decreases  indefinitely  it  eventually 

goes  negative.  Then  the  cut  generated  at  this  point  will  imply  a  pivot  on 

th 

some  column  strictly  to  the  left  of  the  i  .  In  other  words  b^  will  decrease 
strictly  for  some  i  <  1  which  is  a  contradiction.  Since  the  number  of  b's 
is  finite,  the  process  terminates  in  a  finite  number  of  steps. 

2.  Basic  Canonical  Form. 

We  show  in  this  section  that  any  problem  of  form  (1)  or  equivalently 
(l1)  can  be  represented  in  form  (5).  Assuming  we  have  the  problem 
already  in  form  (l1)  we  get  an  equivalent  basic  canonical  form  (5)  to  (1')  by 
subtracting  from  the  first  row  of  the  tableau  an  extra  parameter  t^  and 
adding  two  extra  equations: 

xn+ 1 
Xn+2 

Since  xn+ ^  and  xn+£  are  required  to  be  non-negative,  xr+j  ,  xn+2* 
and  t^+j  must  all  equal  zero  in  any  feasible  solution.  We  have  then: 
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x0  "  b0  +  cOtO  +  cltl  + . +  "  *k+l 

xi  =  ‘o 

x2  =  h  . 

<‘>  •  .  •  •  , 
xk+l  rk 

xk+2  =  bk+2  +  ak+2,  0*0  +  ak+2,  1*1  +  * . +  ak+2,  k‘k 

•  •  •  •  • 

•  •  •  •  ■ 

•  •  •  •  • 

o  •  •  •  • 

x  =  b  4-  a  +  a  ,t.  4* . 4-  a  ,t, 

n  n  nO  0  nl  1  nkTc 

Xn+ 1  =  "  *k+l 

Xn+2  =  +  *k+l 

We  then  perform  the  following  changes  of  variables 
(?)  tjnew  =t^+l-(l+c0)tQ-  ...  -(l-c..1)tj_1-c.tj-cj  +  1t.  +  1 . cktk 

for  j  =  l,...,k+l  and 
.new 

*o  '  *k+l  ~  coto  . . cjtj . ck*k 

The  transformations  of  variables  are  legitimate  because  the  cj'8  are 
strictly  negative;  so,  all  the  coefficients  in  the  above  equations  are  positive 
or  zero  and  the  substitutions  are  column  operations.  Performing  these 
column  operations  we  obtain  the  following  form: 
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Max  Xq  =  bg 


t 


0 


(8) 


*k+l  '  *k  ‘  '  ‘  *k+l 

*k+2  =  bk+2  +  ak+2,  0*0  +  ak+2,  1*1  + . +  ak+2,k+ltk+l 


xn+2  ~  bn+2  +  an+2,  0*0  +  an+2,  1*1  + . +  ^+2^+1^+! 

where  for  notational  simplicity  we  do  not  distinguish  typographically  the 
transformed  coefficients  and  parameters  of  (8)  from  the  old  ones  in  (6). 

To  prove  the  equivalence  of  (8)  and  (6)  it  suffices  to  write  down  the  inverse 
transformation.  In  fact 


.new 

„  new 

*0  =  *0 

C1 

tnew 

.new 

*1  =  *1. 

• 

*2 

• 

• 

• 

- 

.  .new 

.new 

II 

X 

*-» 

*k 

-  *k+i 

Tableau  (8)  is  a  special  case  of  the  desired  form  (5)  with  the  extra 

feature  that  the  new  a..'s  and  b  's  are  zero  in  the  lower  left-hand 

3 

corner  of  the  diagonal  part  of  the  matrix.  The  method  given  above  is  a 
completely  general  method;  however  the  extra  variables  were  added  only 
to  supply  a  coefficient  of  minus  one  in  the  functional.  If  one  already  exists, 
say  c  =  -1,  the  same  transformations  (7)  will  work  with  k  replaced  by  k-1. 

The  algorithm  is  illustrated  by  an  example  in  Appendix  B. 
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III.  Solving  a  Special  Subproblem  for  the  Deepest  Cut 

We  will  now  discuss  a  special  problem  with  interesting  properties, 
which  constitutes  the  basis  for  the  deepest  cut  algorithm  described  in  this 
section. 

1.  The  Deepest  Cut  Problem. 

Let  us  consider  the  following  problem:  Find  non-negative  integers 
x.{j  £  0),  t.,  and  maximize  xn  ,  subject  to: 


a21tl  '  tZ  . 

ak,  lh  + . +  ak,  k-  lbk-  1  "  *k 

xk+l  =  -bk+l  '  ^+1,0*0  “  ak+ 1,  1*1 . ak,  k-  l*k-  1  +  Sc 


X1  =  bl  +  aioto  ' 

x2  =  b2  +  a20t0  + 

(9)  . 

•  •  • 

•  •  • 

•  •  • 

*k  =  bk  +  ak,0t0  + 


where  all  the  b^  (j  ^  0)  and  a.j  are  non-negative  integers. 

It  is  not  difficult  to  see  that,  given  this  structure,  the  lexico- 
minimum  of  all  t  vectors  generating  feasible  x's  is  a  solution  to  the 
problem.  In  order  to  make  more  apparent  some  properties  of  this 
problem  let  us  rewrite  it  for  k  =  3. 


Find  non-negative  integers 
subject  to: 


x.(j  *  0) 


t.  and  maximize  xn, 
i  0 
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bo  = 

bl  = 

x0  +  *0 

-  ajQtQ  +  Xj 

+  tj 

(10)  b2 

"  a20t0 

'  a21tl 

"*■  x2  ^2 

b3 

‘  a30t0 

"  a31tl 

'  a32t2  +  x3  +  *3 

x4 

“b4  ‘  **40*0 

-  a41tL 

-  a42,t2  +  t3 

An  equivalent  statement  of  this  problem  is  to  consider  the  last 
equation  as  the  objective  and  find  the  lexico-min  of  all  the  vectors  t 
which  make  non-negative.  The  solution  of  this  problem  is  an  optimal 

solution  to  the  initial  problem.  So,  we  have  then 

Objective:  x4  =  -b4  -  a^tg  -  a^tj  -  -  tj  . 

The  first  of  the  equations  of  the  system  (the  original  functional)  is  not  really 
a  constraint,  since  tg  may  be  increased  as  much  as  necessary  to  achieve 
primal  feasibility.  In  order  to  make  x4  feasible  (keeping  in  mind  that  we 
are  seeking  the  lexico-min  vector  t),  we  will  first  increase  t^  as  much 
as  possible,  keeping  other  t^  variables  at  zero  value.  This  means,  with 
respect  to  the  simplex  method,  making  t^  and  Xg,  x^,  x^  basic. 

If  we  did  not  succeed  in  reaching  feasibility,  we  would  want  then  to 
increase  t^  keeping  tg  and  t^  at  zero  level  if  this  can  do  some  good, 
i.  e.  ,  if  the  coefficient  of  t.,  in  the  adjusted  "objective"  (x^)  is  greater 
than  zero. 

If  increacing  t~  as  much  as  possible,  (which  is  equivalent  to 
introducing  t^  in  the  basis  when  using  the  simplex  method)  does  not 
suffice  to  make  x^  >  0,  it  means  that  there  is  no  solution  with  tg  =  t^  =0. 
We  then  continue  the  process  with  and  then  with  tg  if  necessary. 
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Performing  these  operations,  there  will  be  some  j  such  that  making 

* 

tj  basic  will  yield  a  non-negative  value  for  (the  value  of  the  adjusted 
objective).  This  implies  that  there  exist  a  solution  to  the  problem  with 


u0 


t^  =  .  . .  =  t j  j  =  0,  tj  basic  and  assigning  some  values  to  basic 


tj+j,  ij+2*  •  •  • » •  But  we  are  seeking  the  lexico-min  vector  t  and  in¬ 
creasing  tj  as  far  as  possible  is  not  necessarily  required.  There  may 
exist  a  value,  say  t j  ,  less  than  the  value  which  is  assigned  to  tj  when 

we  make  it  basic,  which  should  suffice  to  make  x^  reach  feasibility. 

(10) 

In  the  case  where  k  =  3  let  j  =  1 

1)  We  introduce  t^  in  the  basis  then  the  "adjusted  objective"  be¬ 


comes: 


(11)  x4  -  x4  +  x3  -  (b3  -  b4)  +  (a3Q  -  a4Q)t0  +  (a31  -  a41)tj  +U32  -  a42)t2  -  x3 


2)  Assume  b3  -  b4  <0 

If  a32  -  a42  is  >  0,  we  then  consider  increasing  the  value  of 
t2  and  the  new  "adjusted  objective"  will  be  the  following  linear  combination 

x4  =  ^a32  "  a42^x2  +  x3  +  x4  * 

But  let  us  suppose  for  the  sake  of  this  discussion  that  a32  -  a42  _<  0  . 

3.  We  then  consider  increasing  the  value  of  t^  (assuming 
a31  ~a41  ~  >  0)*  Increasing  t^  as  far  as  possible  (or  making  it  basic 

as  in  the  simplex  method)  gives  the  following  adjusted  cost  form 

( 12)  x4  =  x4  +  x3  +  niXl  =  (nib1  +  b3  -  b4)  +  (IIjajQ  +  a3Q  -  a40)tQ  - 

+  (a32  -  a42)t2  -  x3  . 

Let  us  now  assume  that  Il^b^  +  b3  -  b4  >  0  that  implies  that  giving 
to  t ^  the  value  b^.  This  is  sufficient  to  make  x4  reach  feasibility. 
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But  if  we  examine  the  relation  (11)  we  see  that  it  suffices  to  give  to  t^  the 
value 


L  a3 1  “  a41  J  1 


to  make  feasible. 

It  is  easy  to  see  that  the  value  t°  is  less  than  or  equal  to  the  value 
assigned  to  t^  basic.  There  t°  is  the  minimum  value  for  t^  so  that 
there  exist  a  solution  to  our  problem  with  tg  =  0;  this  will  assure  us  that 

tg  =  0  ,  tj  =  t°  ,  t2  =  '  t3  =  t^  ^to 


is  the  lexico-min  vector  t  which  gives  the  solution  of  the  problem,  t^  =  0 
because  the  coefficient  of  t^  was  never  positive  in  the  successive  "adjusted 
cost  forms. " 

In  order  to  determine  the  value  of  t^  we  fix  tQ  =0,  t^  =  t°,  ~  t°  =  0 

and  modify  our  constant  column  accordingly. 


¥3  -  b3  +  a3Q  . 

b4  = -b4-  a4Q  . 


0  +  a31tl  +  a32  * 


0  "  ^l1!  +  a42  • 


0 

0 


Repeating  the  same  operations  as  described  above,  it  is  not  difficult  to  show 
that  t3  =  -b^  .  This  method  is  illustrated  in  Appendix  B  by  an  example. 


Properties  of  the  Deepest  Cut  Problem 

1.  The  procedure  suggested  to  solve  the  deepest  cut  problem  is 
exactly  the  procedure  used  in  the  basic  algorithm  for  generating  cuts. 
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2.  The  procedure  gives  the  best  cut  for  the  equations  of  the  system, 
i.  e. ,  that  given  the  criteria  used  for  generating  efficient  cuts  in  the  basic 
algorithm,  there  is  no  better  cut  possible. 

3.  The  technique  leads  in  a  sequence  of  k  steps  to  the  solution. 

Each  component  of  the  vector  t  is  considered  once  and  only  once  to  enter 
the  basis,  i.  e. ,  if  at  iteration  i/(<  k  +  j+  1)  the  variable  t^  was  not  selected 
for  entering  the  basis,  then  for  all  the  following  iterations  v+  1,  i/+2,  .  .  . 

it  will  never  be  considered  again. 

In  the  case  when  k=  3,  we  have  seen  that  if  at  iteration  i/+2,  t^  has 
a  negative  coefficient,  this  coefficient  always  remains  negative  during  the 
solution  process,  t^  is  never  a  candidate  for  entering  the  basis. 

4.  It  is  possible  to  give  an  upper  bound  for  the  number  of  steps,  i.e., 
each  variable  t  is  considered  only  once  for  entering  in  the  basis  so  the 
number  of  iterations  depends  only  on  the  size  of  the  system  and  is  in  fact  at 
most  k. 


ing 


2.  The  Deep  Cut  Algorithm. 

If  rather  than  dealing  with  the  basic  canonical  form  we  had  the  follow- 
revised  form: 

Find  non-negative  integers  x^  and  ^  and  maximize  xQ  subject  to 


X0 

X1 


*k+l 

^+2 


k+1 


k+2 


n 


+  ak+2;0t0  +  ak+2, 
+  an0  *0  +an,  1 


l.tl  + - +  ak+2,  k+lhc+l 

tj  + - +  an;k+1  t^+l 


t 

t 

t 


k+1 

k+2 

k+2 


Xn+3  "  bn+3  + 

an+3,  0*0 

+  an+3 

Xn+4  bn+4 

an+4,  0*0 

'  an+4 

+  an+3, k+lhc+l  '  *k+2 
"  an+4,  k+^k+l  +  *k+2 
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where  all  the  a^.  and  are  positive  (except  bg  )f  then  a  natural 
algorithm,  using  the  results  of  the  last  section,  suggests  itself. 

In  order  to  obtain  the  revised  form,  starting  from  the  basic  canonical 
form  (8),  we  subtract  from  the  right-hand  side  of  the  equations 

xk+2  =  bk+2  +  ak+2,0t0  +  ak+2,  1*1  + . +  ak+2,k+ltk+l 


Xn+2  ~  bn+2 


a  parameter  t^+^ 


n+3 


n+4 


4a  .  rtt«  +  a  .  .  ,  t ,  +  •  •  • 
n+2, 0  0  n+2,  1  1 

,  and  we  add  two  equations 


+  an+2,  k+l*k+l 


"  *k+2 
+  *k+2 


which  have  the  property  that  t^^,  xn+3*  Xn+4  must  be  e<lual  to  zero 
in  any  feasible  solution. 


We  then  perform  column  operations  in  order  to  make  the  coefficient 
of  tg,  tj,  t^,  ....  j  positive  (except  for  the  coefficients  which  will 
appear  in  the  last  row  n+4  ).  The  equation  generating  the  column  opera¬ 
tions  has  the  form 


(14)  S  -  -0gtg  -  tz 


^Vj  + . ^k+iV+l  +  *k+2 


where  0.  =  -[min  (a. .}]  i  =k+2,k+3,...,n+2,  j  =  1,  2,3,  ...,k+l. 


ij 


To  fix  /3q  we  need  some  more  information.  We  want  the  coefficients 
of  tg  to  be  positive,  but  we  want  also  to  determine  the  coefficients  of  tg 
so  that  when  we  substitute  Kg  +  tg  for  tg  (where  Kg  is  an  admissible 
value  for  tg)  the  constant  terms  become  non-negative. 
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We  know  (when  dealing  with  a  maximization  problem)  that  the  optimal 
solution  (xq  j^p)  of  the  linear  program  is  always  greater  than  or  equal  to 
the  optimal  solution  (xp  jp)  of  the  same  problem  but  where  integral  values 
have  to  be  assigned  to  the  variables. 


o  o 

x0  LP  -  x0  IP 


but  also 


0  LP 


.  o 
-  X0  IP 


let  K0  = 


LP 


+  bp  (initial  bp) 


we  have 


o  ,  ,  o 

+  X0  IP  =  bo  "  ‘o 


"0  LP 


<  -  b0  +  *5 


>  Ko 


so  tp  =  Kp  +  tp.  This  means  that  the  substitution  Kp  +  t^  for  tQ  is  a 
legitimate  operation. 


To  choose  /3q  we  will  assure  ourselves  that  the  coefficients  of  tp 
become  non-negative  and  also  that  when  we  perform  the  substitution  (15), 
described  above,  the  constant  term  column  will  contain  all  non-negative 
components  (except,  the  last  one). 


/3p  =  max 


{'  t 


['^  ]  ‘  a‘°  } 


i0 


max 

i 


i  =  k+2...  .  . ,  n+4 
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After  performing  the  column  operation  generated  by  (14),  i.  e. ,  pivoting  on 


t.  ,  we  then  add  the  cut 
k+2 


s  -  -KQ  +  tQ 


and  pivot  on  t^ 

This  gives  us  the  tableau  (13),  which  is  equivalent  to  our  initial  problem 
with  respect  to  the  integer  valued  solution. 

The  Algorithm 

The  underlying  procedure  is  equivalent  to  the  basic  algorithm  method 
but  in  this  case  there  is  only  one  negative  constant  term,  b^^.  Each 
"subproblem"  will  contain 

1)  the  last  row:  n+4 

2)  one  row  of  the  set  k+2,  ..  . ,  n+2  (the  row  n+3  is  the  opposite  in 
sign  of  the  row  n+4) 

3)  the  diagonal  part  of  the  tableau. 

This  is  exactly  the  structure  of  the  deepest  cut  problem. 

To  generate  the  best  cut  for  each  sub-problem  we  can  use  the  method 
of  the  deepest  cut  problem. 

And  among  those  cuts  select  the  best  one,  using  the  same  criterion 
as  for  the  basic  algorithm. 

This  algorithm  can  be  used  if,  (1)  the  general  problem  can  be  brought 
into  the  necessary  form,  and  (2)  it  can  be  maintained  in  this  form  throughout 
the  pivot  steps.  Both  operations  can  be  performed  although  the  maintenance 
of  non-negative  coefficients  below  the  diagonal  does  involve  some  number  of 
column  operations.  If  we  omit  the  maintenance  of  the  non-negative  coefficient, 
we  have  the  basic  algorithm  discussed  in  the  first  part  of  the  paper.  In  that 
case,  we  generate  deep  cuts  but  not  the  deepest  cuts  for  the  subproblems. 
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APPENDIX  A 


In  the  following  four  figures  a  flow  diagram  for  the  basic  algorithm  is 
given.  Figure  1  tells  us  how  to  get  the  original  problem  in  the  form  (1)  into 
(5).  In  Figure  2  we  associate  to  each  equation  with  a  negative  constant  term 
a  linear  combination  of  equations  in  which  the  coefficients  of  the  rightmost 
t's  have  been  made  non-positive.  In  Figure  3  we  select  the  linear  combina¬ 
tion  for  which  the  last  positive  term  is  furthest  from  the  left,  and  in  Figure 
4  we  actually  perform  the  "cut"  associated  with  this  equation.  The  algorithm 
consists  of  repeating  steps  2-4  until  all  the  constant  terms  are  non-negative. 


1.  CANONICAL  FORM 


Go  on  to 

2.  "DERIVED  EQUATION" 


3.  BEST  CUT 


i 

=  1 

J 

=  K  +  1 

Go  on 
to  4 


i  >  n  +  Z 


Yes 

<J>K+  1 


q*X j  =  (least  integer  > 

divisible  by  a 

which  is 

IJ  * 

t 

/3j  =  -{least  integer  >  bj. 

by  au  } 

divisible 

Pt  *  =  ^T 


?X  :  =  Pr  /  aj j 


alj  =  aIj  '  °1J 


j  =  j  +  1 


APPENDIX  B 


Basic  Algorithm: 

The  original  problem 


Max  Xq  = 

10  "  2t0"  tl  “ 

*2 

X1  = 

*0 

X2  = 

fcl 

x3  = 

*2 

x4  = 

26  +  tQ  -  3tr  - 

5t2 

x5  = 

- 12  +  tQ  +  tj  + 

*2 

Normally  we  use  special  methods  to  generate 
but  in  this  case  this  is  not  necessary. 

Make  the  substitutions 

new 

0 

=  l2  +  2to  +  h 

new 
1 1 

1 

=  *2  +  *0  +  ‘l 

new 

C2 

=  *2  +  l0 

we  then  obtain 

X0  = 

10-  tQ 

X1  = 

to-  4i 

X2  = 

h  - 

*2 

x3  = 

-  4o+  h  + 

*2 

x4  = 

26  +  6tQ  -  9tj  - 

2t2 

X5  = 

-12  +  tj 

(S1=  -15  +  tQ> 
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To  simplify  the  problem  we  make  use  of  a  convenient  device.  If  we  solve  the 

problem  without  the  integer  constraints  we  get  Max  xn  =  9/12  . 

U  LP 

Since  xn  the  integer  programming  solution  is  maximized  over  a  more 
U  IP 

restricted  set  Max  xn  <  Max  xn  .  Therefore,  Max  x_  <  -5. 

UIP  "  ULP  IP  “ 

Since  Xq  =  10  -  tg  to  >  +  15.  This  allows  us  to  introduce  the  cut 

Sj  =  -15  +  tg.  Doing  the  appropriate  pivot  (essentially  tg  :  =  tg  -  15)  we 
obtain: 


If  we  try  to  eliminate  the  coefficient  by  adding  2x^  we  obtain  a  non¬ 
negative  constant  term.  The  last  equation  yields  the  cut 

S!,  =  -8  +  tl  <=>  tl  >  Sx  . 
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Using  x^  =  -12  +  tj  we  try  to  eliminate  t^  but  again  the  constant  term  goes 
non-negative  so  the  best  we  can  do  is  =  -12  +  tj.  The  latter  cut  is  better 
so  we  introduce  =  -12  +  t^.  Completing  the  standard  pivot  operations  our 
tableau  becomes 


here  we  have  only  one  equation  with  a  negative  constant  term  which  implies 
the  cut  =  -3  +  tj  +  t^  making  the  substitution  we  obtain  the  optimal 
solution 


If  we  did  not  use  the  linear  programming  solution  to  generate  the  first  cut 
this  cut  would  have  been 


derived  from  the  following  linear  combination:  x^  +  x^.  The  tableau  then 
becomes: 
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X 

o 

II 

-2  - 

*0 

X1  = 

12  + 

t0 

- 

*1 

x2  ~ 

h  -  *2 

x3  = 

-12  - 

*0 

+ 

*1  +  »2 

n 

rr 

X 

98  +  6tQ 

- 

9tl  -  2t2 

X5  = 

-12 

+ 

our  best  following  cut  is:  =  -12  +  t^  derived  from  x^. 


It  is  not  difficult  to  verify  that  no  better  cut  is  available.  We  then 


obtain: 


x0  =  "2  ‘  t0 


X1  ~ 
x2  =  12 


t0  ‘  tl 


tl  '  *2 


X3  t0  +  tl  +  t2 

x4  =  -1°  +  6t0  *  8*1  -  2t2 
+  t  , 


X5  = 


1 


We  then  get  the  following  cuts 


s3  =  -2  +  tQ 

s  .  -  -  2 
4 

s5  =  -1  +  *0 
s6  =  -1 


+  tl  +  tZ 


+  tl  +t2 


and  obtain  the  same  final  tableau.  It  is  interesting  to  see  that  this  re¬ 
quired  6  cuts  where  the  previous  method  only  required  3  cuts. 


APPENDIX  C 


(a)  We  first  ask  is  there  a  solution  with  tQ.t^t,  =  0  ?  Making  t^ 

basic  and  increasing  as  far  as  we  can  to  t^  =  8  we  get  x^  =  -18. 
Eliminating  t^  from  "OBJ"  we  obtain 

X4  +  X3  =  -  18  -  tfl  -  9tj  +  3t^ 


(b)  Since  x^  with  =  ®  is  =  “18  we  now  allow  t^  to  become 

positive  and  require  only  that  t^.t^  =  0.  Making  t^  basic  and 
eliminating  from  the  "adjusted  OBJ"  we  get 

x4  *  x3  +  ^x2  =  ”9  +  5tg  -  3tj  . 


(c)  Since  the  coefficient  of  t^  is  negative  in  the  current  "OBJ" 
introducing  t^  will  only  make  the  problem  more  infeasible. 

(d)  Finally,  by  making  tg  >  2  we  can  make  the  problem  feasible. 
Since  we  want  the  lexico-  minimum  vector  t  we  take  tQ  = 


2 
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The  values  of  the  rest  of  the  variables  can  be  determined  whether  by- 
back  substitution  or  by  repeating  the  procedure  with  t q  no  longer  a  variable 
but  fixed  at  2,  e.g.,  next  try  to  make  x4  feasible  in 


II 

0 

X 

1 

X1 = 

3  - 

h 

X2  = 

9  + 

2tj 

-  t 

1! 

CO 

X 

8  + 

3tl 

+  6t 

x4  = 

-28  - 

12tx 

-  3t 

Repeating  the  same  process,  we  can  fix  t^;  then  t^,  t^  being  fixed,  and 
so  on. 

The  complete  solution  is 

xQ-l  xl=3  x2  =  0  x3=7  *4=0 

t^  =  2  tj  =  0  *2  =  9  t3  =  33  • 

Practically  one  can  affect  each  row  of  a  multiplier 

t r4  =  l(OBJ),  it*  =1.  n*  =  (a32  -  a42)  =  (6-3)  =  3. 

■n*  =  Max  |(-12  +  3  +  3tt2  )  =  -3,  0  |  =0. 


which  remains  always  the  same  and  may  be  considered  to  some  extent  as 
playing  an  identical  rule  to  the  simplex  multipliers. 
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